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ABSTRACT 

Background: Impact Factor (IF) as a major journal quality indicator has a series of shortcomings including effect of self-citation, review 
articles, total number of articles, etc. In this study, we compared 4 journals quality indices ((IF), Eigenfactor Score (ES), Article Influence Score 
( AIS) and SCimago Journal Rank indicator (SJR)) in the specific Pediatric Neurology journals. Methods: All ISI and Scopus indexed specific 
Pediatric Neurology journals were compared regarding their 2011 IF, ES, AIS and SJR. Results: Fourteen pediatric Neurology journals were 
identified, 3 of which were only Scopus indexed and the others were both ISI and Scopus indexed. High correlation was found between IF 
and AIS (0.850). Correlations between IF and other indices were not that high. Self-citation, total article number and review articles were 
related to the IF and other indices as well as their ranks. English language and citation to non citable item didn't have any effect on pediatric 
neurology journals ranks. Conclusion: Although all the above mentioned indicators can be used interchangeably, using all considered indices 
is a more appropriate way than using only IF for quality assessment of pediatric neurology journals. 
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1. INTRODUCTION 

Bibliometrics methods such as Impact Factor (IF) 
are known as a citation rate measures and are major 
criteria for quality ranking of scientific journals (1, 
2). Calculating the journal's impact factor annually 
is based on the number of citations within a certain 
year to the items published in the journal during the 
two previous years divided by the number of the cit- 
able items in the same interval (3, 4). 

Several drawbacks are associated with the use of 
impact factor as a sole method of journal quality as- 
sessment (5-7). Factors affecting the IF calculation, 
have been criticized recently including: self citation, 
impact of the review articles, citation to non-citable 
items, total number of citable items and English lan- 
guage bias (8-10). The possible misuses of IF in the 
evaluation of journal quality and individual re- 
searchers are controversial issues which draw much 
attention to use other alternative metrics in addition 
to IF (11). 

In 2007, new bibliometric indicators were designed: 
Eigenfactor score (ES) and Article Influence Score 
(AIS). They are freely available and both rank jour- 
nals by a similar algorithm as Google's Page Rank 



does, which reflects not only the number of citations 
but also the prestige of citation source. They have dif- 
ferent time window based on 5 years of citations. ES 
doesn't have denominator and is influenced only by 
total citations not the citable items of a journal. AIS 
calculate the mean influence of citations and is con- 
ceptually the same as SCimago Journal Rank Indi- 
cator (SJR) (12, 14, 15). 

Other addition to the scientometrics is SCimago 
Journal Rank Indicator (SJR) proposed by SCimago 
research laboratory in Spain in 2007(16). SJR is a 
journal quality indicator that uses Scopus indexed 
journals for quality assessment. It is computed using 
similar method as the ES and AIS, but considers cita- 
tions in Scopus database in a 3 years period (17). 

In the present study we sought to compare the four 
mentioned quality metrics in the pediatric neurology 
specific journals. We showed the importance of major 
journal quality indicators besides IF, which are better 
to be considered while deciding for publication of sci- 
entific materials. 

2. METHODS 

Specific pediatric neurology journals were selected 
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2011 Eigen- 
factor Score 


2011 Article 

Influence 

Score 


2011 SCimago 
Journal Rank 
Indicator 


2011 impact 
factor 


0.075 


0.850 


0.736 



Tablel. Comparison of Spearman correlation coefficients 
of 2011 IF with 2011(ES, SJR and AIS) for specific pediatric 
neurology journals. 



from pediatric category of the SCimago journal and 
country ranking website and ISI web of knowledge. 
2011 IFs, ESs and AISs were obtained from Journal Ci- 
tation Report (JCR) through ISI . Relevant information 
was extracted from their source databases including: 
influence of self citations, citations to non-citable items, 
citations to review articles and their influence on 2011 
IFs were assessed. 2011 SJRs were retrieved from its of- 
ficial website: The SCimago Journal & Country Rank. 
Journal ranking according to IF, AIS, SJR and ES were 
compared. Correlations between IFs and other indices 
were estimated by Spearman correlation coefficient. 
Potential impact factors (IF of the journal if it was ISI 
indexed in the 3 previous years) for identified pediatric 
neurology journals which were only Scopus indexed 
were computed using citation overview of the Scopus 
and compared with other ISI indexed journals' IF. All 
analyses were performed by using SPSS version 11.5. 

3. RESULTS 

We identified 11 pediatric neurology specific jour- 
nals indexed by ISI and Scopus and 3 others which 



were Scopus indexed only. Table 1 shows the ob- 
tained Spearman correlation coefficients between 
studied indices (IF, ES, AIS and SJR). All the relevant 
information about journal quality measures in 2011 
(Total citation, total citable items, citation to non-cit- 
able items, citation to review articles and self-citation) 
is summarized in table 2. 

4. DISCUSSION 

This is the first study which compared pediatric 
neurology journals regarding their quality assess- 
ment indicators and we tried to show the importance 
and scientific visibility of pediatric neurology jour- 
nals which are only Scopus-indexed by quality stan- 
dards in addition to IF. We used a new metrics (poten- 
tial IF) to compare the journal regarding their quality. 
Potential IF is calculated assuming a journal to be ISI 
indexed in the previous 3 years. In other words, what 
would be the IF of a journal, if it was ISI indexed? 

Generally high correlation has been reported be- 
tween said journal quality indices (17). In our study 
(as shown in table 1), the highest correlation was be- 
tween IF and AIS (0.850) and other correlations were 
not that high which means there are factors that 
cause differences between journal quality metrics. 
Despite moderate correlation between other metrics 
(IF with SJR and ES), their journal ranks were similar 
to each other with small differences and these mea- 
sures can be used for evaluation of ISI indexed Pedi- 
atric Neurology journals interchangeably. However 
the researchers should be cautious about factors that 



2011 
Article 



Total 
citations 



Journal Name 



2011 2011 Article 2011 

Impact factor/ Eigenfactor Influence SCimago 2q\q 

rank score/rank Score/ rank/rank ... 

, articles in 

rank ^ 



Citable 
items in 
2009 and 
2010 



Citations 

to non cit- Self citations 

able items of the journal 

of 2009 to 2009 and 

and 2010 2010 articles 

in 2011 in 2011 (%) 
(%) 



Citations 
to review 
articles of 

2009 and 

2010 in 

2011 (%) 



Journal of Neurodevelop- 
mental Disorders 


3.062/1 


0.00119/10 


1.346/1 


0.158/2 


147 


48 


4 (2.7) 


10 (6.8) 


7(4.7) 


Developmental Medicine 
And Child Neurology 


2.918/2 


0.01465/1 


0.961/2 


0.162/1 


995 


341 


157 (15.7) 


142 (14.2) 


177 (17.7) 


European Journal of 
Paediatric Neurology 


2.123/3 


0.00413/6 


0.643/3 


0.148/4 


346 


163 


13 (3.7) 


30 (8.6) 


104 (30) 


Journal of Child Neurol- 
ogy 


1.748/4 


0.01158/2 


0.546/4 


0.143/5 


806 


461 


48 (5.9) 


88 (10.9) 


103 (12.7) 


Seminars in Pediatric 
Neurology 


1.652/5 


0.00218/9 


Ox 


0.153/3 


114 


69 


2 (1.75) 


6 (5.2) 


112 (98.2) 


Developmental Neurore- 
habilitation 


1.577/6 


0.00085/11 


Ox 


0.055/11 


153 


97 


3 (1.9) 


41 (26.7) 


30 (19.6) 


Child Nervous System 


1.542/7 


0.00828/3 


0.411/8 


0.088/9 


683 


443 


17 (2.4) 


121 (17.7) 


60 (8.7) 


Journal of Neurosurgery- 
Pediatrics 


1.533/8 


0.00441/5 


0.439/7 


0.1/8 


578 


377 


0 (0) 


102 (17.6) 


28 (4.8) 


Pediatric Neurology 


1.522/9 


0.00811/4 


0.483/5 


0.112/7 


557 


366 


0(0) 


37 (6.6) 


101 (18.1) 


Neuropediatrics 


0.937/10 


0.00247/7 


0.458/6 


0.137/6 


104 


111 


7(6.7) 


6(5.7) 


7(6.7) 


Pediatric Neurosurgery 


0.703/11 


0.00226/8 


0.298/9 


0.062/10 


109 


155 


0(0) 


1 (0.9) 


24 (22) 


Journal of Pediatric 
Neurosciences 


0.25V 12 






0.033/12 


17 


68 








Journal of Pediatric 
Neurology 


0.12V13 






0.032/13 


18 


148 








Iranian Journal of Child 
Neurology 


0.102V14 






0.027/14 


7 


68 









Table 2. Rankings of the pediatric neurology journals in 2011 according to SCimago, Impact Factor, Eigenfactor score and Article 
Influence score. *: Computed potential impact factor for Scopus indexed pediatric neurology journals. *: These two journals haven't 
been ISI indexed for 5 years, so they don't have any AIS. 
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affect the ranking order. Pediatric researchers should 
consider other journal quality metrics in addition to 
IF for publication of their researches. 

Scopus as an extensive database indexes many 
journals from different countries and languages. SJR 
measure has shown some differences with IF, it if 
less affected by self-citation and include all type of 
articles in its denominator not only ISI citable items 
namely original and review articles (20, 21). Three of 
14 Pediatric Neurology journals were Scopus indexed 
only (Journal of Pediatric Neurosciences, Journal of 
Pediatric Neurology and Iranian Journal of Child 
Neurology). Their potential IFs were 0.25, 0.12 and 
0.102 respectively. These potential impact factors are 
fairly respectable and show that ISI indexed journals 
are not the only visible journals in the pediatric neu- 
rology field. 

Total number of citable items constitutes the IF 
denominator and is one of the issues that affects IF 
annually (20). Journals can increase their IF by de- 
creasing the total number of their citable items. 
Among the four journal quality metrics mentioned in 
the current study, ES does not have any denominator 
and is sensitive to total number of citable items. In 
other words journals with low number of articles are 
likely to have lower ES (22). Low number of citable 
items for Journal of Neurodevelopmental Disorders 
is the possible reason of its 1st place in IF ranking de- 
spite ranking 10 lh by ES. 

ISI consider 2 types of articles (original and review 
articles) as the only citable items which are counted 
in the denominator of IF fraction. Publishing high 
amount of non-citable items which can receive con- 
siderable number of citations will boost the IF be- 
cause they won't be counted in the denominator. SJR 
considers all type of articles in its denominator and is 
less influenced by non-citable items. It is suggested to 
use SJR indicator, in addition to IF for quality evalu- 
ation of journals which publish high amount of non- 
citable items (17). In our study of Pediatric Neurology 
journals no considerable citation to non-citable items 
was observed. 

In general, number of citation to an article is re- 
lated to the type of cited article. Usually review ar- 
ticles have the higher probability of getting cited than 
original articles (5, 21). Our study also supported this 
concept. One of our considered journals, Seminar in 
Pediatric Neurology, only publishes review articles 
(98.2% of total 2011 citations to 2009 and 2010 items 
were citations to review articles). None of the evalu- 
ated journal quality metrics in our study are taking 
into account the type of the cited articles. However 
journals publishing only review articles usually have 
low amount of citable items as was the case for Semi- 
nars in Pediatric Neurology (69 articles in 2009 and 
2010). Among the compared indices, only ES can indi- 
rectly shows the effect of the type of the cited article. 
Because it doesn't have any denominator, journals 
with lower number of articles or journals that only 
publishes review articles will acquire lower ES rank 



(rank of Seminar in Pediatric Neurology dropped 
from 5 th for IF ranking to 9 lh for ES ranking) (21). 

Another strategy for some journals to boost their 
IF is self-citation. In calculation of IF, there is no cor- 
rection for self citation therefore editors tends to en- 
courage citing their previous works to improve their 
journal IF (5, 23). Other journal quality indicators (ES, 
AIS, SJR) take into account the self citation since by 
self citation there would be no prestige transfer and 
no increase in these indicators. Highest self citation of 
Pediatric Neurology Journals was found in Develop- 
mental Neurorehabilitation (26% of its total citations). 
This can be a reason for the lower ranking for ES and 
SJR (ll lh place) despite higher rank of IF (6 lh place) of 
this journal. 

For the interpretation of IF parameter, 2 years will 
be used as a time window, however for Eigenfactor 
scores (ES and AIS) 5 years period of time will be 
considered. Journals which are ISI indexed for less 
than 5 years won't have any AIS rank and their ES 
will be low. Time duration that a journal has been 
ISI indexed should be taken into account while using 
these two metrics (14). Two of our considered jour- 
nals (Seminars in Pediatric Neurology and Develop- 
mental Neurorehabilitation) didn't get any AIS rank 
because they haven't been ISI index for 5 years. This 
may be the other reason of the lower ES ranks for two 
mentioned Pediatric Neurology journals in addition 
to publishing review articles or using self citation. 

Another factor that has an effect in increasing the IF 
of a journal is English language bias. Articles which 
are in English language get more citation compared 
to other languages (20). All the studied Pediatric Neu- 
rology journals were in English language, and no 
journal language effect in Pediatric Neurology jour- 
nals' ranking was observed. 

5. CONCLUSION 

To conclude, although IF is believed as the most 
common journal quality indicator, there are some 
drawbacks associated with its using as a sole crite- 
rion that draw attention to consider other journal 
quality indices. Some pediatric neurology journals 
are only Scopus indexed and can be evaluated partic- 
ularly by SJR. In our opinion, journal editors should 
get familiar with the factors influencing IF (such as 
self citation, non-citable items, etc), in order to avoid 
using them liberally as new journal quality metrics 
are available which could account for these factors. 
Researchers and journal editors should be aware of 
these new journal quality metrics as they are more 
likely to be used in the future due to shortcomings 
of the IF. 
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